Experiences of aiding autobiographical memory using the sensecam

Human memory is a dynamic system that makes accessible certain memories of events based on a hierarchy of information, arguably driven by personal significance. Not all events are remembered, but those that are tend to be more psychologically relevant. In contrast, lifelogging is the process of automatically recording aspects of one's life in digital form without loss of information. In this article we share our experiences in designing computer-based solutions to assist people review their visual lifelogs and address this contrast. The technical basis for our work is automatically segmenting visual lifelogs into events, allowing event similarity and event importance to be computed, ideas that are motivated by cognitive science considerations of how human memory works and can be assisted. Our work has been based on visual lifelogs gathered by dozens of people, some of them with collections spanning multiple years. In this review article we summarize a series of studies that have led to the development of a browser that is based on human memory systems and discuss the inherent tension in storing large amounts of data but making the most relevant material the most accessible

Fast human activity recognition in lifelogging

This paper addresses the problem of fast Human Activity Recognition (HAR) in visual lifelogging. We identify the importance of visual features related to HAR and we specifically evaluate the HAR discrimination potential of Colour Histograms and Histogram of Oriented Gradients. In our evaluation we show that colour can be a low-cost and effective means of low-cost HAR when performing single-user classification. It is also noted that, while much more efficient, global image descriptors perform as well or better than local descriptors in our HAR experiments. We believe that both of these findings are due to the fact that a user’s lifelog is rich in reoccurring scenes and environments

Lifelogging user study:bystander privacy

Automatically and passively taking pictures (using lifelogging devices such as wearable cameras) of people who don’t know they’re having their picture taken raises a number of privacy concerns (from a bystander’s perspective). We conducted a study focussing on the bystanders’ concerns to the presence of augmented reality wearable devices in two contexts (one formal and one informal). The results suggests the need to embed privacy enhancing techniques into the design of lifelogging applications, which are likely to depend upon an array of factors, but not limited to the context of use, scenario (and surroundings), and content

A qualitative exploration of memory cuing by personal items in the home

© The Author(s) 2017. We are surrounded by personal items that can trigger memories, such as photos, souvenirs and heirlooms. Also during holidays, we collect items to remind us of the events, but not all bring back memories to the same extent. Therefore, we explored peoples’ responses to personal items related to a holiday, using the home tour interviewing method. In total, 63 accounts of cuing responses from nine home tours were analysed using thematic analysis. This resulted in four types of cuing responses: (a) ‘no-memory’ responses, (b) ‘know’ responses, (c) ‘memory evoked think or feel’ responses and (d) ‘remember’ responses. For each of these cuing response categories, we looked into the types of items and their characteristics. Furthermore, we found that some items can evoke multiple memories. The majority of the memories’ content refers to events close to the moment of acquiring the item

"Touchscreen Assessment Tool" (TATOO), an Assessment Tool Based on the Expanded Conceptual Model of Frailty

Frailty is a common clinical syndrome in older adults; it carries an increased risk of negative health events and outcomes including falls, incident disability, hospitalization, and mortality. Therefore, it is critical to identify high-risk subsets of the elderly population and explore new arenas for frailty prevention and treatment. This chapter will provide an overview of the current state of assessment models for frailty syndrome in the elderly and will describe a new assessment tool based on mobile technology, which takes account and advantage of the ways in which elderly people interact with a touchscreen. While healthcare providers and researchers in the field of aging have long been aware of the changing characteristics and needs of older people living in the community, there has not been any marked change in frailty syndrome assessment models until now. In the twenty-first century world with its technological advancements, the elderly require new, special physical skills combining perceptual, motor, and cognitive abilities for their functional daily activities and for maintaining their independence and quality of life

Developing a Method to Test the Validity of 24 Hour Time Use Diaries Using Wearable Cameras: A Feasibility Pilot

Self-report time use diaries collect a continuous sequenced record of daily activities but the validity of the data they produce is uncertain. This study tests the feasibility of using wearable cameras to generate, through image prompted interview, reconstructed 'near-objective' data to assess their validity. 16 volunteers completed the Harmonised European Time Use Survey (HETUS) diary and used an Autographer wearable camera (recording images at approximately 15 second intervals) for the waking hours of the same 24-hour period. Participants then completed an interview in which visual images were used as prompts to reconstruct a record of activities for comparison with the diary record. 14 participants complied with the full collection protocol. We compared time use and number of discrete activities from the diary and camera records (using 10 classifications of activity). In terms of aggregate totals of daily time use we found no significant difference between the diary and camera data. In terms of number of discrete activities, participants reported a mean of 19.2 activities per day in the diaries, while image prompted interviews revealed 41.1 activities per day. The visualisations of the individual activity sequences reveal some potentially important differences between the two record types, which will be explored at the next project stage. This study demonstrates the feasibility of using wearable cameras to reconstruct time use through image prompted interview in order to test the concurrent validity of 24-hour activity time-use budgets. In future we need a suitably powered study to assess the validity and reliability of 24-hour time use diaries

Passively recognising human activities through lifelogging

Lifelogging is the process of automatically recording aspects of one's life in digital form. This includes visual lifelogging using wearable cameras such as the SenseCam and in recent years many interesting applications for this have emerged and are being actively researched. One of the most interesting of these, and possibly the most far-reaching, is using visual lifelogs as a memory prosthesis but there are also applications in job-specific activity recording, general lifestyle analysis and market analysis. In this work we describe a technique which allowed us to develop automatic classifiers for visual lifelogs to infer different lifestyle traits or characteristics. Their accuracy was validated on a set of 95 k manually annotated images and through one-on-one interviews with those who gathered the images. These automatic classifiers were then applied to a collection of over 3 million lifelog images collected by 33 individuals sporadically over a period of 3.5 years. From this collection we present a number of anecdotal observations to demonstrate the future potential of lifelogging to capture human behaviour. These anecdotes include: the eating habits of office workers; to the amount of time researchers spend outdoors through the year; to the observation that retired people in our study appear to spend quite a bit of time indoors eating with friends. We believe this work demonstrates the potential of lifelogging techniques to assist behavioural scientists in future. © 2011 Elsevier Ltd. All rights reserved